Adversarial Manifold Estimation
نویسندگان
چکیده
This paper studies the statistical query (SQ) complexity of estimating $d$-dimensional submanifolds in $\mathbb{R}^n$. We propose a purely geometric algorithm called Manifold Propagation, that reduces problem to three natural routines: projection, tangent space estimation, and point detection. then provide constructions these routines SQ framework. Given an adversarial $\mathrm{STAT}(\tau)$ oracle target Hausdorff distance precision $\varepsilon = \Omega(\tau^{2 / (d + 1)})$, resulting manifold reconstruction has $O(n \operatorname{polylog}(n) \varepsilon^{-d 2})$, which is proved be nearly optimal. In process, we establish low-rank matrix completion results for SQ's lower bounds randomized estimators general metric spaces.
منابع مشابه
Manifold Assumption and Defenses Against Adversarial Perturbations
In the adversarial-perturbation problem of neural networks, an adversary starts with a neural network model F and a point x that F classifies correctly, and applies a small perturbation to x to produce another point x′ that F classifies incorrectly. In this paper, we propose taking into account the inherent confidence information produced by models when studying adversarial perturbations, where...
متن کاملMinimax Manifold Estimation
We find the minimax rate of convergence in Hausdorff distance for estimating a manifold M of dimension d embedded in R given a noisy sample from the manifold. Under certain conditions, we show that the optimal rate of convergence is n−2/(2+d). Thus, the minimax rate depends only on the dimension of the manifold, not on the dimension of the space in which M is embedded.
متن کاملManifold Regularized Deep Neural Networks using Adversarial Examples
Learning meaningful representations using deep neural networks involves designing efficient training schemes and well-structured networks. Currently, the method of stochastic gradient descent that has a momentum with dropout is one of the most popular training protocols. Based on that, more advanced methods (i.e., Maxout and Batch Normalization) have been proposed in recent years, but most stil...
متن کاملManifold-valued Image Generation with Wasserstein Adversarial Networks
Unsupervised image generation has recently received an increasing amount of attention thanks to the great success of generative adversarial networks (GANs), particularly Wasserstein GANs. Inspired by the paradigm of real-valued image generation, this paper makes the first attempt to formulate the problem of generating manifold-valued images, which are frequently encountered in real-world applic...
متن کاملThe Robust Manifold Defense: Adversarial Training using Generative Models
Deep neural networks are demonstrating excellent performance on several classical vision problems. However, these networks are vulnerable to adversarial examples, minutely modified images that induce arbitrary attacker-chosen output from the network. We propose a mechanism to protect against these adversarial inputs based on a generative model of the data. We introduce a pre-processing step tha...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Foundations of Computational Mathematics
سال: 2022
ISSN: ['1615-3383', '1615-3375']
DOI: https://doi.org/10.1007/s10208-022-09588-2